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We investigate the universal inequalities relating the a-Renyi entropies of the marginals 
of a multi-partite quantum state. This is in analogy to the same question for the Shannon 
and von Neumann entropy (a - I) which are known to satisfy several non-trivial inequal- 
ities such as strong subadditivity Somewhat surprisingly we find for < a < 1, that the 
only inequality is non-negativity: In other words, any collection of non-negative numbers 
^**^ 1 assigned to the nonempty subsets of n parties can be arbitrarily well approximated by the 

ff-entropies of the 2" - 1 marginals of a quantum state. 

For a > 1 we show analogously that there are no non-trivial homogeneous (in particular 
no linear) inequalities. On the other hand, it is known that there are further, non-linear and 
' indeed non-homogeneous, inequalities delimiting the a-entropies of a general quantum 

O-l state. 

Finally, we also treat the case of Renyi entropies restricted to classical states (i.e. probabil- 
ity distributions), which in addition to non-negativity are also subject to monotonicity. For 
1 a + 0, 1 we show that this is the only other homogeneous relation. 
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I. PROLOGUE 

00 

CN " The von Neumann entropy S (p) = - Tr p log p of a quantum state p is a key notion in quan- 

tum information theory 14311 as well as in statistical physics [3l|]. It is furthermore the canonical 
measure of entanglement for bipartite pure states fl6fl. In many cases the relative magnitude of 
the entropy of the reduced states of different subsystems is important. Thus for example for a 
tripartite state Pabc one can compute Sip a), Sips), and so on. For any positive number a one can 
find a quantum state such that S(pa) - a, for example. However for a fixed quantum state, there 
are inequalities between the values of the entropies of the reduced states of the subsystems. 

There are essentially two such unconstrained inequalities known (up to permutation of the 

' 



parties), strong subadditivity and weak monotonicity |20l,l37fl : 



S {pabc) + S (p B ) < S (pab) + S (pbc), 

S(pa) + S(p b )<S(pac) + S(pbc)- 

There are no other constraints for up to 3 parties, but the analogous statement is a major open 
problem for larger n [8t|2lt|37|]. Indeed we anticipate that the question may be very complicated 
in general. For example the analogous question for classical (Shannon) entropies has been much 
studied and in this case, for n > 4 there are infinitely many independent (linear) inequalities 
known JU IS l4rjl- All these inequalities, and more discovered by Makarychev et al. [23] and 
Dougherty et al. [11] might very well hold for the von Neumann entropy, too. Indeed it is known 
that the von Neumann entropy satisfies some constrained inequalities that are counterparts of 
known classical constrained inequalties 
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For a state of n parties there are 2" - 1 non-trivial von Neumann entropies, one corresponding 
to each non-empty subset of parties. Thus the existence of these inequalities means that given a 
set of 2" - 1 positive numbers there will, in general, be no quantum state whose reduced state 
entropies have these values. 

In this paper we consider the analogous questions for quantum Renyi entropies, also called 
a-entropies [38fl, of a quantum state p (given as a unit trace density operator on a suitable Hilbert 
space): 

S a {p) = -^—\ogTvp a , (2) 
1 - a 

for < a < oo. (We note that the case of a - 1 is the von Neumann entropy). 

We will show that, very surprisingly, the case of Renyi entropies for a + 1 is much different 
from that for the von Neumann entropy: 

For < a < 1, we will show (in theorem^ that the only inequality is non-negativity S a (p) > 0. 
In other words, any collection of non-negative numbers assigned to the nonempty subsets of 
n parties can be arbitrarily well approximated by the a-entropies of the 2" - 1 marginals of a 
quantum state. 

For a > 1 we will prove that there are no linear (or indeed homogeneous) inequalities. We 
show (in theorem [7]) that given any vector v of 2" - 1 positive numbers, it may or may not be the 
case that this is the vector of the 2" - 1 marginals of a quantum state; however it is arbitrarily 
well approximated by a positive multiple of the a-entropies of the 2" - 1 marginals of a quantum 
state. On the other hand (contrary to the case < a < 1) there are other, nonlinear, inequalities 
delimiting the set of possible entropy vectors; one such inequality was proved in [4|], which we 
recall in section ITVl 

Finally, we show (in section [V} that in the classical case the only homogeneous inequalities are 
non-negativity and monotonicity (under the inclusion of subsets of parties), for all a ^ 0, 1 . 



II. THE RENYI ENTROPY 



The definition in (O is clearly well-defined, and continuous in the state as well as in a, for 
a e (0, oo) \ {1}. For a = 0, 1, oo, the function is defined by taking a limit, yielding 

S (p) = log rank p, 

Si(p) = S(p) '■= -Trplogp (von Neumann entropy), 
5oo(p) = -logllpll, 

where || • || denotes the operator norm, i.e. ||p|| is the largest eigenvalue of p. 

By their definition, all of the quantum Renyi entropies depend only on the spectrum of p, 
which we can think of as a probability distribution P. In this sense, the above formulas generalise 
the notion 

. X J 

introduced by Renyi in his axiomatic investigation of information measures for random variables 
and their distributions J3^], following Shannon's example [3^] . This approach has generated a lot 
of subsequent activity 

It is easy to see that for states p > 0, Trp = 1, all S a (p) > 0, with equality if and only if p 
is pure, i.e. a rank-one projectors = \(pX<f\- Furthermore, for fixed p, the function a h-> S a (p) is 
monotonically non-increasing [38fl. 
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Many other useful, interesting and curious mathematical properties of the Renyi entropies are 
known [lfl. 

Renyi entropies, and, more generally, Renyi relative entropies and the corresponding channel 
capacities play an important role in classical as well as quantum information theory. The Renyi 
quantities with parameter a e (0, 1) are related to the so-called direct domain of information the- 
oretic problems. They can be used to quantify the trade-off between the rates of the two types of 
error probabilities in binary state discrimination 1ZL|18, 30], which in turn yields a trade-off 

relation between the error rate and the compression rate in state compression (see [10] for the 
classical case; the quantum case is completely analogous). The related capacities quantify the 
trade-off between the error rate and the coding rate for classical information transmission |10l,ll7l| . 



and can be used to obtain lower bounds on the single-shot classical capacities [28]. The Renyi 
quantities with parameter a > 1 are related to converse problems. They can be used to quantify 
the trade-off between the rates of the type I error and the type II success probability in binary 
state discrimination | hj 16 , 34]], as well as the trade-off between the rate of the success probability 
and the compression rate in state compression [10]. The related capacity formulas give bounds 



on the success rate for coding rates above the Holevo capacity ]10j, |22, 34], and can be used to 
give upper bounds on the single-shot classical capacities of quantum channels |29Q . Also, Renyi 
entropies feature prominently in the theory of bipartite pure state transformations by local op- 
erations and classical communication: Only recently it was shown [3] that the monotonicity of 
the Renyi entropies of the reduced states for a > 1 is both necessary and sufficient for catalytic 
transformations (whereas unassisted transformations are long known to be characterized by ma- 
jorization ]13, 32]). And in Jl^ , Renyi entropies (essentially a - and a = oo) were used to put 
bounds on the classical communication required for a given transformation. And finally, Renyi 
entropies were employed to put lower bounds on the communication complexity of certain dis- 
tributed computation problems [25l,l42l1 . 

While the von Neumann entropy can be obtained as the limit of the Renyi entropies for a — > I, 
and hence it can be considered as one particular member of this parametric family of entropies, 
its basic properties sharply distinguish it from all other members of the family. Indeed, while the 
von Neumann entropy is strongly subadditive, the other Renyi entropies with a e (0, +oo) \ {1 j are 
not even subadditive. 

To illustrate the consequences of this difference, we mention the problem of entropy asymp- 
totics on spin chains. Given a translation-invariant state p on an infinite spin chain, subadditivity 
of entropy ensures the existence of the limit s(p) := lim„^ +0o \S{p[\^ n {), where P[\, n ] is the restriction 
of p to any n consecutive sites, and sip) gives the ultimate compression rate for an ergodic p |@]. 
More refined knowledge about the decay of error for rates below s(p) can be obtained using the 
method developed in Ijlal ; for this, however, one has to show the existence of the regularized 
Renyi entropies s a (p) := lim„^ +00 a {p[\,n\) for every a e (0, 1). Due to the lack of subadditivity, 
the existence of this limit is not at all straightforward, and is actually only known for some special 
classes of states fli.l26l.l27ll. 

When p is pure, the block entropies S a {p[\^) are used to measure the entanglement between 
the block [1, n] and the rest of the chain, and the scaling of these entropies are closely related to the 
presence or absence of criticality in the system |12.l4l[ |. It follows from strong subadditivity that 
the entanglement entropy S(p[i,„]) is a monotone increasing function of the block size 0]. This 
is no longer true when the entanglement is measured by some Renyi entropy; a counterexample 
with oscillating block Renyi entropies for a > 2 was found in [15]. It is not known, however, 
whether such oscillating behaviour can happen for Renyi entopies with parameter a arbitrarily 
close to 1 . 

In the view of the above examples, it is natural to ask whether there are other universal in- 
equalities between the Renyi entropies of the subsytems of a multipartite quantum system, and 
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this is what we are going to investigate in the following. 

To fix notation, we shall concern ourselves with «-partite quantum systems with generic tensor 
product Hilbert space 'H = 'Hi ® • • • ® 'H n . Within the discussion we usually consider n and a to 
be fixed, but the local systems are unconstrained, i.e. we do not impose limits on the dimension 
of the 'Hi. For a state p on *H we have the reduced states pi = Tr/c p, with the partial trace over all 
parties in the complement I c = [n] \ I, and we shall consider them and their entropies all at once, 

for all non-empty subsets of [n] = {1 n}. The power set and the power set without the empty 

set we denote as follows: 

9>[n] := {/ c [n]}, 

P 9 [n] := {/ C [n] : I * 0} = P[n] \ {0}. 

We are interested in the universal relations obeyed by the a-entropies of a general rc-party state 
p. For instance, by definition clearly 

S a <Pl) > 

for all subsets / c [n] . 

Note that via the usual diagonal matrix representation we can view a probability distribution 
of n discrete random variables as a quantum state, and conversely, states which are diagonal in 
a tensor product basis of an «-party system can be identified with a classical rc-party probability 
distribution, and hence we will call states of that form classical. In this case, there is another 
inequality, 

S a {pi) < S a (pj) 

for I a J, i.e. monotonicity of the entropy function with respect to subset inclusion. 
These examples motivate the introduction of the set of all entropic vectors, 

2£ := {(S a (pj)) IePdn] : p state) c R*M 
and the same for classical case 

K '■= {( 5 <*(P/)W e [it] : P classical state} 

= {(H a (Pi)) l€Pdn] ■ P prob. distr.) c R p « w . 

In fact, as we tend to consider "<"type inequalities between continuous functions of the coor- 
dinates, it makes sense to focus on the topological closures F£ c R p ^ n \ Those universal 
inequalities we are looking for are the constraints describing the geometric shape of these sets. 

The above examples of known inequalities are homogeneous, indeed linear, relations. (By 
a homogeneous inequality we mean an inequality of the form f(\) > 0, v € where / is a 
homogeneous function on R^^, i.e., there exists ad eR such that f(A\) = A d f(\) holds for every 
A e R>o and v e R > q [ " ] .) That it is meaningful to look for such relations is motivated by the 
observation that all Renyi entropies are extensive, i.e. 

S a (p <S> cr) = S a (p) + S a ((T). 

And since this is true for all subset reduced states simultaneously, we have for non-negative inte- 
gers k and i, 

]CL a + €L a c L a , kT a + £T a c T a , 

and likewise for the respective closures. If this held for non-negative reals it would mean that the 
corresponding set is a convex cone. This is indeed known for a = 1 |37l,l44n , but not true for a > 1 
(see below). 



5 



III. 0<a<l 



In this section, a is fixed in the interval (0, 1). We start off with a simple classical construction. 
For / e Pq)[n], let 5/ denote the corresponding basis vector in R^« w , i.e., 6j is the characteristic 
function of the singleton {/}. 



Lemma 1 For any s > 0, the vector s6[„] e R^ 1 " 1 is approximately a-entropic, i.e. sS^ e E£. In fact, this 
vector can be approximated arbitrarily by classical states. 

Proof For integers M\,...,M n consider "local" alphabets Xi := {0} U [M ; ] and define distributions 
Pf,{Mi} (0 < t < 1) on the Cartesian product X\ x • • • x X n as follows: 



-fV{M,|(*i, • • • ,x n ) :- 



1 - Z if xi = . . . = = 0, 
Mi---m„ i£xi,...,x n ±0, 
otherwise. 



The marginals on Xi - X/e/*^// f° r a subset / c [n], are easy to construct: they are given precisely 
by Pr,{MrJei}( x i '■ i 6 I)- The corresponding quantum state and its marginals hence are 



P= P f;{M,-}(*i,-..,*n)l*iX*il® \x n \x n \, 

Xl,...,X„ 

Pi=Yu P t'{Mf'ei](xi \xiXxA. 



xf.iel iel 

With this, the Renyi entropies are straightforward to compute: 



SaiPl) = log ((1 - tf + fM)-<*) , 



withM, = UieiMi. 

Now, for sufficiently large M[„], we can set 



i 

' 2*(i-Q') _ 1 V 



M , 

[n] 



Then, in the limit min{Mi, . . . , M n ] —> oo, 

SaiPw) = lo § ((! - 0" + 2' s(1 " a) - l) -» J, 

since t -> 0. On the other hand, for / c [«], 



5 a (p/) = -: log 

1 - a 



(l-0 ff + 



o, 



because M,- -> oo. □ 

Proposition 2 For any ^ / c [«], and s > 0, tTze sector sd/ e zs approximately a-entropic, 

i.e. s5i e ££. 
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Proof It is enough to show that for any e > 0, there exist local systems "Hi,.. ., ( H n , ( H n +] and a 
pure state p = \ifr)(ifr\ on 'Hi ® • • • ® TY,, ® , K, J+ i with 

* - e < S a (fii) < s + e, and S a (pj) < e if 7 c [n], 7^7. 

If 7 = [n], we just use the (n + l)st party to purify the state. If |/| = 1, we likewise take the 
classical state of lemma [TJ on the «-party system [n + 1] \ I and purify it using the system I. Thus, 
from now on we may assume that k = \I\ and I = \I C \ - n + 1 — k are both > 2. The idea is that for 
integer M, the distributions P n \M c :iei} on t ne systems I, and P t ;{M k :jei c } on the systems I c - [n + 1] \ I, 
both with the same t given by 



t - 



have the same nonzero probabilities, just arranged differently. In other words, the corresponding 
classical states are isospectral, hence we may view them as reduced states of an (n + l)-party pure 
state. 

In detail, we may without loss of generality relabel the systems such that I = { 1 , . . . , k} and 

I L ' - {k + 1, . . . , k + t - n + 1}. For every i e {1, . . . , k] and j £ {1 €), let TCy be an M-dimensional 

Hilbert space with an orthonormal basis [\k)ij : k - 1, . . . , M}, and define 



f i 



<8>* 

7=1 



( k 



<H k+j := C|0>* + ; © 



(g)%7 



where |0>,- are unit vectors. For akx£ matrix x e [M] and / e { 1, . . . , k], j e {1, ... let 

e k 



l*»> := 



x^> (7 € iJCot+i) ) : = (X) >'7 e ?W 



7 



7=1 



i=l 



and 



n+l 



|^r> := VT^7 (g) |0)i + ^ |x (1) > . . . |x w >|x ( , +1) > . . . |*( B+ 1)>. 



(=1 



xe[M]* 



(Here |x>|v> stands for \x) ® |y>.) 

Let p := p[„] = Tr„ + i |tAX<Al- The crucial property of this definition is that every party i € I and 
7 e I c have a coordinate in common, namely Xj e [AfJ. One can easily see that p/ is a classical state 
of the type studied in lemma [l] and the same calculation as in lemma [TJ shows that 



S„(pi) = T^— log((l - 0° + 2' s(1 " a) - l) 
1 - a v 7 



as M — > oo. If / e Pai[n] is different from 7 then there are i e I and j e I c = [n + l]\ I, such that either 
i, j e / or /, 7 e J c . The second case has entropy equivalent to the first since we may just go to the 
complementary set. In the first case, we have 

PJ = (1 - t) (g) 10X01/ + to; 

ieJ 

where cr is supported on a space which contains each %j at most once if the ith or the (k + j')th 
system has been traced out, and twice otherwise. Hence, 



cr = 



\iejnl ;'e/n[n]\7 



i CT 
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where 

M 



m = ^Y J \k)ij\k)i j e<K ij ®<K ij , 

and cr' is a density operator supported on a space of dimension at most M kc ~ l . Hence, S a (cr) = 
S a (o-') < logM kf ~\ or equivalently, Tver" < M^{-m-a)_ This yields 



S a {pj) < j-^— log ((1 - t) a + M< ke - m - a h a ) 
1 - a v 1 



1 log((l-0 a + -J-(2' v(1 - ff )-l)|^0, 



as M — » oo. □ 

Theorem 3 Eoery element v e R^® 1 -^ zs approximately a-entropic. In other words, there are no non-trivial 
inequalities constraining the Renyi entropies (with fixed a < I) of a multi-party state: The only restriction 
is non-negativity: 

Proof Via proposition [2] this is quite obvious: Observe v = H/ e! p e [„] v i^i> an d that for each subset 
/ c [n] we can find an n-party state p (/) such that its entropies arbitrarily approximate vjdj, i.e. 

\S a (pf) - vi5 u \ < e for all /, J c [«]. 
Letting p := (^^p^ we are done, since e can be chosen arbitrarily small. □ 

Remark 4 From theorem\3\we can see that 1%, is not a closed set (assuming n > 2). Indeed, we found 
that for any / c [«], the ray R>o5/ is in However, it is easy to see that except for the origin, none 
of its points s6i can be an element of £*. 

For otherwise there would be a state p with S a (pi) = s and all other S a (p j) = 0. Now, if |/| > 2, 
say / = {ii, ii, . . .}, then S a (pi) - implies that all single-party marginals p\ are pure, meaning that 
p - pi ® • • • ® p n is pure, too. Hence we would have S(pi) = as well. If on the other hand / = {/}, 
then we may choose j £ / and reason similarly that pj is a pure state, hence p(,j) = pi ® p ; and so 
S(fi\i,j}) = S(pi) + S(pj) - s ^ 0, obtaining a contradiction again. 



IV. 1 < a < oo 



As in the previous section, we start with the basic construction to attain entropy vectors arbi- 
trarily close to the coordinate axes. Throughout the section, 1 < a < oo is fixed. 

Lemma 5 For all s > 0, there is a vector s5[„\ + 0(1) e To be precise, there exists a constant C, which 
may be chosen as C = -j-jr log n, and classical states with 

a 

s<S a (p)<s + C, and S a (pj) < C for J + [«]. 



In particular, 5[„] e R>o 
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Proof The following argument is presented for a < oo; to obtain the claims in the case a = oo one 
simply takes the limit. 

For an integer M consider "local" alphabets Xj := {0} U [M] and define distributions Q[ n \.R on 
the Cartesian product X\ X • • • x X n as follows: 

(i/?Oi) if * and * ; = 0V j * /, 
10 otherwise, 

where R is an arbitrary probability distribution on [M]. 

For the corresponding classical state, it is straightforward to verify that 



S a (P[n]) = 7— log 

1 - a 



= \ogn + H a {R). 



A=l 



On the other hand, the marginal state pj for any / c [n] has an eigenvalue A > -, hence 

1 1 

S a (fii)<- \ogA a <- log - =C, 

1 - a 1 - a \nj 

and we are done, since we can choose M large enough to accommodate a distribution R on [M] 
with H a (R) = s. □ 

Proposition 6 For all s > and I e V%\n\, there is a vector s5i + 0(1) € To fee precise, there exists a 
constant C, which may be chosen as C = — V log(|/|(n + 1 - |/|)), and states with 

a 

s<S a {pi)<s + C, and S a (fij) < C for J ± I. 



In particular, Si € R>o 

Proof If / = [n], this is lemma [5j but we shall present a direct quantum construction, of a pure 
state on n+ 1 parties; hence view / as a subset of [n+1]. Pick a distribution R on some finite alphabet 
[M] with H a (R) = s and fix a purification of R - understood as a quantum state R = J^ x R(x)\x)(x\ -, 

L"> = Zf=i VR00U>l*>. 

Now, construct the following (n + l)-party pure state vector, 



^ M^ijT™ 

1 " 1 ielJeF 



where F - [n + 1] \ /, and p := Tr, !+ i |(AX<Al- However, our reasoning will be based on the pure state 
|^X<Al- Above, the direct sum means that we take direct sums of the local Hilbert spaces, which we 
indicate by the label "ij" attached to each local system, whereas |/i>,y is the state shared between 
parties i and j. 

It is straightforward to check that 



hence S a (I) = s + log(|/||/ c |). On the other hand, if J c [n] with J ± 1, then there exist i € / and ; 6 I c 
such that either both i, j e / or both i, j € J c . Thus, p j has a direct sum component \fi)(ji\ and as a 
consequence an eigenvalue > jj^, hence 

and we are done. □ 
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Theorem 7 For every element v e R>" w f/zere is a vector v + 0(1) e £*. To be precise, there exists a 
constant C, which may be chosen as C = -V(log(n + 1))2" +1 , and states with 

a 

\S a (pi) - v/| < C for all I c [n]. 

In other words, there are no non-trivial homogeneous inequalities constraining the Renyi entropies (with 
fixed a > I) of a multi-party state: The only restriction is non-negativity: 



Proof Using proposition [6] this is trivial: v - E/eP B [n] v i$ir an d for each subset I c [n] we can find 
an rc-party state p (/) such that its entropies approximate vj5i, i.e. 

\Sa(p^P) ~ vi6j j\ < — — r log n for all /,7 c [ri\. 
1 - - 

a 

Letting p := ® IePt[n] p (I \ we are done. □ 

Remark 8 From theorem^7\we can see that R>oS^, is not a closed set (assuming n > 2). This is argued in 
the same way as in remark [4] for the case a < 1. 

The above theorem [7| looks quite similar to theorem [3] for < a < 1. However, whereas there 
we could conclude that there are no nontrivial inequalities whatsoever for the Renyi entropies 
of a multi-party state, here we only get that there cannot be any further homogeneous inequalities 
apart from non-negativity. 

That this is the most we can hope to obtain follows from the observation that there are other, 
non-linear and non-homogeneous, inequalities constraining the entropy vectors. In fact, is not 
a cone at all for a > 1 ! 

An example of such an inequality was presented by Audenaert [4]: The a-Schatten norm \\p\\ a = 
(Tr|p|*)i/« (the operator norm ||p||oo = llpll is obtained in the limit a — > oo) is related to the a-entropy 
by 

a 

S a (p) = log ||pL, 5 oo(p) = - log llplU, 

1 - a 

and satisfies 

IIpaL + IIpbL < i + WpabL 

for arbitrary bipartite state pab- 

The following is a strengthening of Audenaert's inequality. 

Proposition 9 Let pab be a bipartite state and 1 < a < oo. Define 

M a := max{(||p A |L /UpAlUr 1 ,(||p B |L /UpBlUr 1 ) for a < oo, 

as well as := lim a ^ +00 M a = max{l/raA, l/wi#}, where ma and mg are the multiplicity of UpaIIoo an d 
WpbWco as an eigenvalue of p A and p B , respectively. 
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Then, 

IIpaIU + WpbK ^ min I* + \ \\PAB\\ a ■ M a < *j (4) 
= {2yJW^L if Ma < ^ IbL (5) 

< i + IIpabIU • (6) 

The last inequality holds with equality if and only if at least one of p A ,p B or pab is a pure state. Moreover, 
we have \\pA\\ a + \\pb\\ = 1 + HpabIL if and only if p A or p B is a pure state. 

Proof We follow Audenaert's proof 0] with a slight modification. Let pA - Tii M e i)( e i\ and 
Pb - Y>j Vj\fj)(fj\ be eigen-decompositions such that the A's and the n's are arranged in a decreasing 
order. For a = oo, define X := ^ki><e,i Y := ^Ifdifil and let yS := 1. For a < oo, define 
X := £/*;k;X<?il and F := 'Zjyj\fj)(fjl where 

Xj := if' 1 / IIPAlir 1 and ^ := tfT 1 / Hpsl!* -1 - 

and let /? be such that ^ + 1 = 1. Let a; and v be the vectors formed of the x/s and y/s, respectively. 
Then \\X\\ fi = \\Y\\ fi = \\x\\ fi = \\y\\p = 1 and \\p A \\ a = TrXp A and ||p B || a = Tr Yp B . Hence we have, for any 
real number ac, that 



IIPAlU + WPbL = Tr(X 8 I B + 7 A 8 F)p AB 

= ac + Tr(X <g> I B + I A 8 F - kI a 8 Ib)Pab 
< k + Tr(X ® I B + I A ®Y - kI a ® I b )+pab 
= K + TrZ K p A B, 



(7) 



where Z K :- (X® I B + I A ®Y - k! a ® Ib)+ is the positive part. 

Consider now the function a i-> ^(a) := (X/Cy; + a - = ll(y + a — This function is 

convex, / K (/c) = \\y\\ B = 1, and /*(0) = if we assume that ac > max ; - yj = WyW^. Hence, under this 
assumption, f K (a) < a/tc for every < a < ac. Thus, if ac > HjcIL then 

\\Z K \fp = ||(X 8 / B + I A 8 F - *r/ A 8 Z B ) + ||J - ^(jc, +y j - K f + = Y J Mxif 

i,j i 

<^( Xi / K f = \\x\\p^ = 1//, 

i-e., llZJIyj < 1/ac. Due to Holder's inequality, TrZ K p AB < \\Z K \\ B \\p AB \\ a < \\p AB \\ a Ik. Combined with 
0, this yields 

IIPaIU + WPbL <k+- \\pab\1 -■ g{K). (8) 

K 

Since this is true for every ac > maxlll^H^, , HylD = M a , we have proved eq. ©. 

It is easy to see that g is strictly convex and it has a global minimum at yijpAfiiL - 1 with 
minimum value of 2 YiipAfiiiT ■ m particular, g is strictly decreasing on the interval (0, VIIPabIU] and 
strictly increasing on [ -J\\p~ab1\^, l]/ and hence we obtain eq. (0. The inequality ((6]| is obvious. 

By the above properties of g, we have equality in (O if and only if max [M a , ^J\\p A ~BVi = 1. 
Obviously, a/IIpabIU = 1 if and only if p AB is a pure state, and it is easy to see that M a - 1 if and 
only if pa or p B is pure. 
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If p A is a pure state then p AB = p A ®p B and 1 + ||pabIL = 1 + \\Pa\\ HpsL = 1 + IIPsL = IIpaL + IIpbIL 
and a completely similar argument works if p B is pure. On the other hand, if \\pa\\ + llpslU = 
1 + IIpabIU then equality has to hold in ©, and hence pa,Pb or pab has to be pure. If pab is pure 
but p A is not then \\p A \\ a = HpslU < 1 and hence \\p A \\ a + WpbK < 2 = 1 + WpabL- This proves the last 
assertion about the equality case. □ 

It appears that even for two parties, no description of 1? a or !,„ is known. Nor, which other 
inequalities there are constraining the latter. 



V. CLASSICAL CASE 

As remarked in the introduction, if restricted to classical states p, the Renyi entropies are mono- 
tonic, i.e. 

IcJ => S a (pi) < S a (pj). (9) 

(More generally, this holds for separable states, thanks to the majorisation result of Kempe and 
Nielsen [33].) In this section, we denote the set of a-entropic vectors of a generic distribution 
of n random variables by T n a . In other words, this is a subset of 1T a , with the restriction that the 
underlying states are classical. 

The extremal rays of the convex cone MO" described by non-negativity and eqs. (© - which 
thus contains T n a - are easy to describe in combinatorial language [19]: They are precisely the rays 
spanned by the indicator functions 

fl if /el/, 
hi ■ I ■— » i 

10 otherwise. 

of a nonempty set family 14 c !P@[«] with the property that J d I e14 implies J ell (hence always 
[n] e 14). Such set families are known in combinatorics as "upsets" (or sometimes "ideals"). 
Some of the simplest upset are generated by a single element: 

t/ = {/€P,[n] :JcI). 

These have the property that the unique minimal element of the family is /. Note also that an 
upset contains, with each element J, the entire f J. This means that every upset H can be written 

with £, the set of minimal elements of 14. 

For instance for n - 2, there are four upsets and clearly all four associated rays are attainable 
(whole ray for a < 1, sufficiently long dilution for a > 1). 

Next we show that this is the only difference to the quantum case, at least as long as we are 
only looking for homogeneous inequalities. Namely, the only homogeneous inequalities obeyed 
by the classical a-entropies are non-negativity and monotonicity. 

Theorem 10 Let < a < 1. For any upset 1A c V%\n\ and all s > 0, there is a vector s i<u + 0(1) € Y n a . To 
be precise, there exists a probability distribution P with 

s < H a {Pi) <s + lQg I£l + 1 for Ie14, H a {Pi) < log |£| + 1 for I £14. 
I - a 



In particular, for s —> oo we obtain i<u e R>q TJ. As a consequence, R>o T% = MO". 
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Proof Let 1i - U Je £ t J, which can be achieved by choosing X to be the minimal elements of U. 
For each i e [n], let the local alphabet X, be of the form 



Xi = U* Je£ Xij, where 



\X U = {0} U [M^, if i e 

\\x u \ = i a a j, 



where U* denotes disjoint union, i.e., Xjj and Xij> are disjoint iiJtJ'. For each J e X, let P t j-{Mr.iej} 
be a probability distribution on x,- e jXij c Xi e jXi, defined as in lemma [fl with tjMj~ a = 2 s (l ~ a \ 
where s' :- s + log |X|. Let Qj := P tj ;{Mi:ieJ} ®5j c , where 6jc is the trivial probability distribution 
on the single-element set XiejcXij. Note that the supports of Qj and Qj> are disjoint for J + J'. We 
claim that 



W Je£ Je£ 



Ptj;{Mj.ieJ) ® <^/ c 



has the desired properties for large enough Mq := min, M,. 
Indeed, it is easy to see that for any + I c [n], 



1 



1 

1 -or 



log 
log 



1 



\£\ a 
l 



^l + ^((l-/ ; f + 2 s ( 1 -»») + 2 (d-^r + 2^/M^7) 



Urv=0 



7c/ 



<b*J\KJ 



1 



M ->+oo 1 — a 



1X1° 
logllXI 



Un/=0 

1_a + 2*'( 1_Q ') 



IXI 

#|/e£ : J c /} 



/AT 



l-a 
7\7 



Q*J\IQJ 



\-C\ a 



— !— log (|X| 1_a + 2 4(1 - Q,) #{/ e X : J c /}) , 
1 - a v 7 



(10) 



where in all summations over J above, J e X is implicit. Now, ii I etl then there exists a / e X 
such that 7 c/, and hence the expression in ((To)) can be lower bounded by s, and upper bounded 
by ^ log (|X| (l + 2 i(1 ~ a) )]< 5 + On the other hand, if / £ «W then #{7 e X : / c 7} = and 

hence the expression in flOl) is equal to log |X|. □ 

Theorem 11 Let 1 < a <oo. For any upset 1A c Pq[ii] and s > 0, £/zere is a vector si<u + 0(1) € Y n a . To be 
precise, there exists a constant C, which may be chosen asC = — ^j- log(2?/) if 14 is generated by k elements 

a 

(k < 2 n always), and a probability distribution Q with 

s < H a (Qi) <s + Cfor IeW, ff a (<2/) <C fori t<U. 

In particular, for s — > oo we obtain i<u e R>o T n a . As a consequence, R>o T n a = MO n . 

Proof Let M be the smallest natural number such that s < 1 + log M. We take as our building 
blocks the distributions Q\n\.M from lemma|5]and its proof, for simplicity with uniform R on [M]. 
Furthermore, define the following uniform distribution on the diagonal of [M] n : 



M 



x=l 



Now, for upset U = \J Je£ T J, let 

1 

: = — A , , ffi ^ 



Q ■= 2 A m' 



\ (g)(27:M ' 



>6 X . 



> Sjc), 



Je£ 
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where 8 jc as before refers to a generic point mass for parties J c = [n] \ J, the product over J e £ 
implies Cartesian products of the local alphabets, and the direct sum likewise a direct sum of the 
local alphabets. 

The first term in the direct sum makes sure that in each marginal the largest probability value 
occurring is at least > jjjj, with multiplicity M, not allowing the Renyi entropy of any subset to 
become larger than log M + -if. Turning to the second term, note that in the tensor product over 

J € £, the distributions are designed such that for J <z I, the distribution (Qj-m ® Sjc) I is uniform 
on \J\M elements, whereas for / <£ I, it has at least one value > ^ . 
Thus, 

{< -rr log(2n*) for I ill, 

H a (Ql) l ~a 

I > 1 + log M for / e 14, 
and we are done. □ 



VI. EPILOGUE 



We have carried out an analysis of the inequalities obeyed by quantum Renyi entropies in 
multi-partite systems, in analogy to the very deep ongoing programme for the von Neumann 
entropy. In the quantum case, our findings can be summarized concisely as saying that apart 
from trivial non-negativity of individual entropies there are no inequalities obeyed by the Renyi 
or-entropies of a multipartite state, when < a < 1 . For 1 < a < oo there are no other homogeneous 
inequalities, but the set of attainable entropic vectors is not a cone, meaning that there are further, 
non-homogeneous inequalities. In the classical case (and more broadly that of separable quantum 
states) there is furthermore monotonicity in the sense that a smaller subset of parties cannot have 
larger entropy, and we could show similarly that this is the only homogeneous inequality for all 
a + 1. It is curious to contrast this with the limit a = 1, the von Neumann entropy, which is subject 
to subadditivity and strong subadditivity, as well as triangle inequality and weak monotonicity, 
all crucial relations for the development of statistical mechanics and quantum information theory. 
The classical case has even more inequalities, due to Zhang and Yeung and subsequent work. 

We did not discuss the other limit a = 0, for which the Renyi entropy is the logarithm of the 
rank of the density operator, which indeed behaves rather differently from the other a-entropies: 
For one thing, it takes only discrete values in the logarithm of integers, and it is discontinuous. 
Furthermore, it is easy to see that it obeys subadditivity 



S oiPiuj) < S (p/) + S o(pj), 



and it is unknown which other inequalities (whether homogeneous, linear or other) it satisfies. 
Note however that it definitely does not satisfy strong subadditivity [90- 

We leave a few other open questions and further directions for future investigations: For in- 
stance, we would like to know all necessary non-homogeneous inequalities to describe the 
Note that the classical/ separable sets r" t for a > 1 are not cones either, but what about < a < 1? 
Finally, and perhaps most interestingly in the light of recovering what rich structure is known for 
a - I, can we extend the present investigation to relations between Renyi entropies for different 
a? For example, it is well-known that for a < ft, S a (p) > Sp(p), or S a {pAB) ^ S a (ps) + So(Pb), but 
we do not know which other inequalities, if any, exist. 



14 



ACKNOWLEDGMENTS 

We thank Marcus Huber and Josh Cadney for conversations on Renyi entropies, and especially 
Josh Cadney for providing a counterexample showing that the 0-entropy does not obey strong 
subadditivity. 

NL and AW are supported by the European Commission (STREP "QCS" and IP "QESSENCE"). 
MM is supported by a Marie Curie Fellowship ("QUANTSTAT") of the European Commission. 
AW received furthermore support from the ERC (Advanced Grant "IRQUAT"), a Royal Society 
Wolfson Merit Award and a Philip Leverhulme Prize. The Centre for Quantum Technologies is 
funded by the Singapore Ministry of Education and the National Research Foundation as part of 
the Research Centres of Excellence programme. 



[1] J. Aczel, Z. Daroczy, On Measures of Information and Their Characterizations, Academic Press, New York, 
1975. 

[2] R. Alicki, M. Fannes, Quantum dynamical systems, Oxford University Press, Oxford, 2001. 
[3] G. Aubrun, I. Nechita, "Catalytic Majorization and ( p Norms", Commun. Math. Phys. 278:133-144 
(2008). 

[4] K.M.R. Audenaert, "Subadditivity of ^-entropies for q > 1", J. Math. Phys. 48:083507 (2007); 
arXiv[math-ph]:0705.1276. 

[5] K.M.R. Audenaert, M. Nussbaum, A. Szkola, F. Verstraete, "Asymptotic error rates in quantum hy- 
pothesis testing", Comm. Math. Phys. 279:251-283 (2008). 

[6] C.H. Bennett, H.J. Bernstein, S. Popescu, B. Schumacher, "Concentrating partial entanglement by local 
operations", Phys. Rev. A 53(4):2046-2052 (1996). 

[7] I. Bjelakovic, A. Szkola, "The Data Compression Theorem for Ergodic Quantum Information Sources", 
Quantum Information Processing 4:49-63 (2005). 

[8] J. Cadney, N. Linden, A. Winter, "Infinitely many constrained inequalities for the von Neumann en- 
tropy", IEEE Trans. Inf. Theory 58(6):3657-3663 (2012);irXiv:1107.0624 

[9] J. Cadney, personal communication, June 2012. 
[10] I. Csiszar, "Generalized cutoff rates and Renyi's information measures", IEEE Trans. Inf. Theory 41:26- 
34, (1995) 

[11] R. Dougherty, C. Freiling, K. Zeger, "Six new non-Shannon information inequalities", IEEE 
Int. Symp. Inf. Theory, pp. 233-236 (2006); "Networks, matroids, and non-Shannon information in- 
equalities", IEEE Trans. Inf. Theory 53(6):1949-1969 (2007). 

[12] J. Eisert, M. Cramer, M.B. Plenio, "Area laws for the entanglement entropy - a review" Rev. Mod. Phys. 
82:277 (2010) . 

[13] L. Hardy, "Method of areas for manipulating the entanglement properties of one copy of a two-particle 

pure entangled state", Phys. Rev. A 60(3):1912-1923 (1999). 
[14] P. Hayden, A. Winter, "Communication cost of entanglement transformations", Phys. Rev. A 

67:012326 (2003). 

[15] S.M. Giampaolo, S. Montangero, F. Dell' Anno, S. De Siena, F. Illuminati, "Scaling of the Renyi en- 
tropies in gapped quantum spin systems: Entanglement-driven order beyond symmetry breaking", 
larXiv:1208 .0735 (2012). 

[16] M. Hayashi, Quantum Information: An Introduction, Springer Verlag, Berlin Heidelberg, 2006. 

[17] M. Hayashi, "Error exponent in asymmetric quantum hypothesis testing and its application to 

classical-quantum channel coding", Phys. Rev. A 76:062301 (2007). 
[18] F. Hiai, M. Mosonyi, T. Ogawa, "Error exponents in hypothesis testing for correlated states on a spin 

chain", J. Math. Phys. 49:032112 (2008). 
[19] B. Ibinson, N. Linden, A. Winter, "All Inequalities for the Relative Entropy", Commun. Math. Phys. 

269(l):223-238(2007). 

[20] E.H. Lieb, M.B. Ruskai, "Proof of the strong subadditivity of quantum-mechanical entropy", 
J. Math. Phys. 14(12):1938-1941 (1973). 



15 



[21] N. Linden, A. Winter, "A new inequality for the von Neumann entropy", Commun. Math. Phys. 
259:129-138(2005). 

[22] R. Koenig, S. Wehner, "A strong converse for classical channel coding using entangled inputs", 
Phys. Rev. Lett. 103:070504 (2009). 

[23] K. Makarychev, Y. Makarychev, A. Romashchenko, N. Vereshchagin, "A new class of non-Shannon- 
type inequalities for entropies", Commun. Inf. Syst. 2(2):147-165 (2002). 

[24] F. Matus, "Infinitely many information inequalities", IEEE Int. Symp. Inf. Theory, pp. 41-44 (2007). 

[25] A Montanaro, A. Winter, "A Lower Bound on Entanglement-Assisted Quantum Communication 
Complexity", in: Proc. ICALP 2007, L. Arge et at (eds.), LNCS 4596, Springer Verlag, Berlin Heidel- 
berg, 2007. 

[26] M. Mosonyi, F. Hiai, T. Ogawa, M. Fannes, "Asymptotic distinguishability measures for shift- 
invariant quasi-free states of fermionic lattice systems", J. Math. Phys. 49:072104 (2008). 

[27] M. Mosonyi, "Hypothesis testing for Gaussian states on bosonic lattices", J. Math. Phys. 50:032105 
(2009). 

[28] M. Mosonyi, N. Datta, "Generalized relative entropies and the capacity of classical-quantum chan- 
nels", J. Math. Phys. 50:072104 (2009). 

[29] M. Mosonyi, F. Hiai, "On the quantum Renyi relative entropies and related capacity formulas", IEEE 
Trans. Inf. Theory, 57:2474-2487 (2011). 

[30] H. Nagaoka, "The converse part of the theorem for quantum Hoeffding bound", 
|arXiv:quant-ph/0611 289 (2006). 

[31] J. von Neumann, "Thermodynamik quantenmechanischer Gesamtheiten", Nachr. Ges. Wis- 
senschaften Gottingen, year 1927, pp.273-291 (1927), 

[32] M.A. Nielsen, "Conditions for a Class of Entanglement Transformations", Phys. Rev. Lett. 83(2):436- 
439 (1999). 

[33] M.A. Nielsen, J. Kempe, "Separable States Are More Disordered Globally than Locally", 
Phys. Rev. Lett. 86(22):5184-5187 (2001). 

[34] T Ogawa, H. Nagaoka, "Strong converse to the quantum channel coding theorem", IEEE Trans. In- 
form. Theory 45:2428-2433 (1999). 

[35] T Ogawa, H. Nagaoka, "Strong converse and Stein's lemma in quantum hypothesis testing", IEEE 
Trans. Inform. Theory 47:2428-2433 (2000). 

[36] N. Pippenger, "What are the laws of information theory?", 1986 Special Problems in Communication 
and Computation Conference, Palo Alto, CA, 3-5 September 1986. 

[37] N. Pippenger, "The inequalities of quantum information theory", IEEE Trans. Inf. Theory 49(4):773- 
789 (2003). 

[38] A. Renyi, "On Measures of Entropy and Information", in: Proc. Fourth Berkeley Symp. on Math. 

Statist, and Prob., J. Neyman (Ed.), pp. 547-561 (1960). 
[39] C.E. Shannon, Bell Syst. Tech. J. 27:379-423 & 623-656 (1948). 
[40] C. Tsallis, J. Stat. Phys. 52(l/2):479-487 (1988). 

[41] G. Vidal, J.I. Latorre, E. Rico, A. Kitaev, "Entanglement in quantum critical phenomena" 

Phys. Rev. Lett. 90:227902 (2003). 
[42] W. van Dam, P. Hayden, "Renyi-entropic bounds on quantum communication", 

|arXiv:quant : ph /0204093 (2002). 

[43] M.M. Wilde, "From Classical to Quantum Shannon Theory", larXiv:1106.144 5 (2011). 

[44] R.W Yeung, "A Framework for Linear Information Inequalities", IEEE Trans. Inf. Theory 43(6):1924- 

1934 (1997). 

[45] Z. Zhang, R.W. Yeung, "A Non-Shannon Type Conditional Inequality of Information Quantities", 

IEEE Trans. Inf. Theory 43(6):1982-1985 (1997). 
[46] Z. Zhang, R.W. Yeung, "On the characterization of entropy function via information inequalities", 

IEEE Trans. Inf. Theory 44(4):1440-1452 (1998). 



